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Abstract 

An elementary collision model of a molecular reservoir is consid- 
ered upon which an external field is applied and the work is dissi- 
pated into heat. To realize macroscopic irreversibility at the micro- 
scopic level, we introduce a "graceful" irreversible map which ran- 
domly mixes the identities of the molecules. This map is expected to 
generate informatic entropy exactly equal to the independently calcu- 
lable irreversible thermodynamic entropy. 

1 Introduction 

The thermodynamic entropy 5^ crmo of a given equilibrium reservoir is equal 
to the informatic (Shannon-von Neumann) entropy 

S[p R ] = -tx(p R \ogp R ). (1) 

The pn is the corresponding Gibbs canonical state of the reservoir, taken 
in the infinite volume (thermodynamic) limit. If we switch on a certain 
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external macroscopic field to perform work on the reservoir then the state 
p R (t) starts to evolve reversibly while, from the thermodynamic viewpoint, 
part of the work will be dissipated into heat in the reservoir. There is a 
common expectation that the irreversible thermodynamic entropy production 
also equals the change of the informatic entropy of the reservoir: 

A irr S£™ = S[p R {t + At)] - S[p R (t)). (2) 

As it is well-known this equation does not hold because p R (t) evolves unitar- 
ily and the r.h.s. is always zero. This is the notorious conflict between the 
reversibility of the reservoir's microscopic dynamics and the macroscopically 
observed irreversible dissipation. In our case this dissipation is "friction" 
against the external field. Various resolutions of this contradiction between 
the microscopic and macroscopic theories are possible. None of them is gen- 
eral and none of them is able to prove the exact identity of the thermody- 
namic and informatic entropy productions. Obviously, any resolution must 
impose some deliberate irreversibility on the unitary dynamics. For a sys- 
tematic study, we formalize this irreversibility as a completely positive map 
M. applied to the reservoir state repeatedly. Then we expect that 

A irr ^ hcrmo = S[Mp R (t + At)] - S[p R (t)] (3) 

holds exactly for microscopically short intervals At. The map M. we are 
looking for must be graceful. It should not alter the macroscopic reaction 
(e.g. the friction force) of the reservoir on the field. Moreover, it should be 
such that it conserve the free dynamics of the reservoir: 

M[H R ,p R (t + At)] = [H R ,Mp R (t + At)\, (4) 

where H R is the reservoir's Hamitonian. 

In our work we construct an elementary reservoir model composed of dis- 
tinguishable molecules and postulate a discrete reversible (unitary) collision 
dynamics for its interaction with the external field. In this model the thermo- 
dynamic entropy production Ai rrl S' thermo is exactly calculable. Then a natural 
projection M. is found that expected to increase the information entropy of 
the reservoir by A irr S' thermo exactly. The map M. symmetrizes the state p R 
for all distinguishable molecules, i.e., it mixes the ones which collided with 
the external field among all molecules throughout the reservoir. The identity 
(0) relies upon a novel conjecture concerning the increase of the informatic 
entropy under the projection M.. We have heuristically proved the theorem 
for the classical case. 
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2 The reservoir, collisions 

Assume a single molecule with a Hamiltonian H in the Gibbs-equilibrium 
state p at inverse temperature (5: 

Let the molecule interact with a certain external field and let us describe the 
interaction by the following "collision": 

p^UpW = a, [U,H}^0, (6) 

where U is unitary. Suppose our reservoir is formed by the ideal gas of n 
such distinguishable molecules in equilibrium: 

p R = p®p®...p = p® n , (7) 

with the Hamiltonian 

H R = H® I® {n - l) + I®H® I® {n - 2) + / 0(n - 1} ® H, (8) 

and its thermodynamic limit is n — > oo. Let us assume that the molecules will 
reversibly collide with the field in succession, see Eq.flHJ). Without restricting 
the generality, we can assume that the 1st molecule collides first, the 2nd 
collides second, e.t.c: 

p m ^a® p®^- 1 ) _> a ® a ® p®(™- 2 ) -> . . . (9) 

Since S'fcr] = the informatic entropy of the reservoir has not changed at 
all in the above reversible collisions: 

S[p® n ] = S[a ® p®^- 1 )] = S[a ® a ® p®^} = ... = nS[p] = nS[a\. (10) 

For simplicity, we consider the 1st collision and implement our idea for 
it. If we calculate the mean energy transfer from the field to the molecule we 
obtain: 

AE = tr(aH) - tr(pH) = ^lo^) - trjalog p) } Q (n) 

P 

The proof is straightforward if we express logp = —f3H — logZ from (jSJ), 
substitute it, and observe that tr(plogp) = tr(crlogcr). The r.h.s. above is 
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proportional to the informatic relative entropy <S[cr|/9] of the post- and pre- 
collision states, which is always positive. In a reversible process, a Gibbs- 
state will always absorb energy from the field. If the molecule is part of 
a reservoir and the field interacts with many molecules in succession then, 
thermodynamically, we expect that the above mean energy is dissipated to 
the reservoir. Therefore the average thermodynamic entropy production per 
collision is, on thermodynamic grounds: 

A irr S thcTmo = PAE = S[a\p]. (12) 

We see that A irr S' thermo is always positive since S^cxlp] is always positive if a ^ 
p. We emphasize that the above identity is part of common knowledge and is 
different from our target identity. The relative entropy which is microscopic 
plays an auxiliary role in the calculations. We are looking for the informatic 
entropy production whose value shall coincide with the relative entropy. Our 
target identity is: 

A irr S thcrmo = AS R , (13) 

where ASr is the increase of the informatic entropy between the post- and 
pre-collision states of the whole reservoir. We already noticed that ASr 
would remain zero after the 1st unitary collision. The point is that we have to 
define a new post-collision state of the reservoir, which differs from a^p®^ 1 ^. 



3 The graceful irreversible map 

Now we have to postulate a (completely) positive map M. which is irreversible 
and graceful: 

a <g) _> M (a <g> p®^" 1 )) . (14) 

The map should correlate the molecules. Single-molecule maps can increase 
the informatic entropy but they would not produce the requested value 
SVH- We need a map which does only smear out information whose loss is 
heuristically justifiable in a molecular reservoir. Let the map M. be the total 
randomization over the identity of the n molecules. In our case: 

M(a® p® (n ij ) = . 

v ' n 

(15) 
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It is clear that this post-collision map is irreversible and increases the in- 
formatic entropy of the reservoir. Moreover, it is consistent with Eq.(J3J in 
conserving the energy. 

In the Appendix we are going to illustrate for the classical case that the 
informatic entropy increases by the relative entropy of the post- and pre- 
collision states. According to this novel mathematical conjecture: 

ASr = lim (S[M(a ® p®^)] - S[a ® p®^ 1 )]) = S[a\p). (16) 

n=oo 

This would confirm the central physical identity (jSJ). This says that our model 
yields exact identity between the independently defined thermodynamic and 
informatic entropies. The key element of the model is a graceful irreversible 
map postulated after each reversible interaction of the field with a molecule. 



4 Discussion 



Realistic microscopic models of dissipation are not calculable exactly. Note 
that both the irreversible thermodynamic A irr S' thermo and the informatic ASr 
entropies should be calculable independently and exactly. Our model is less 
realistic while it allows exact calculation and confirmation of Ai rr S' thermo = 
ASr. Our elementary model can be improved or varied in certain ways. For 
instance, the map M. does not need to be repeated after each collision, it may 
be applied after several collisions — the main result remains. The collision 
dynamics is, however, essential. If we resolved it into a smooth Hamiltonian 
evolution the model would become fundamentally sensitive to the repetition 
frequency of the irreversible map A4. 

In the spirit of the present work, a particular version of the model ap- 
peared already in [2] as the model of classical mechanical friction. The rela- 
tionship of the map M. to the Gibbs principle of molecular undistinguishabil- 
ity has been discussed although not fully persued. This is probably a deeper 
issue and subject of future research. 

Analysis of friction phenomena in a reduced single molecule description 
can be based on a two step cyclic process @]. The first is identical to Eq. (JHJ) . 
The second step is an irreversible map generated by the phenomenological 
Lindblad operator which restores the system to its initial state. The cyclic 
requirement means that all entropy has to be generated in the reservoir. 
Unlike the present model, in the Lindblad formulation there is no explicit 
description of the graceful map that generates the desired entropy production. 
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5 Asher 



Asher has strived for internal consistency between independent but related 
branches of physics. This outlook is reflected in his Book [T| where he has 
linked numerous thermodynamical aspects to quantum theory and vice versa. 

Following von Neumann, Asher proves that the equilibrium quantum in- 
formatic entropy is genuine thermodynamic entropy (p. 270). One reads 
the derivation of a version of our Eq. 1)11)1. see p. 269, Eq.(9.24). One also 
learns the heuristic derivation of the Shannon informatic entropy (p. 260) we 
exploited in the Appendix. Asher invoked thermodynamical argument par- 
ticular in a debate on hypothetic nonlinear Schrodinger equations, p. 278, 
see also Pj. The power of thermodynamic arguments may show itself in our 
present work: the novel mixing entropy conjecture (Appendix) for quantum 
entropies has so far not been proven but it is strongly supported by the 
physical wisdom that the thermodynamic and informatic entropy produc- 
tions should coincide. 

Acknowledgment. We thank the Israel Science Foundation and the Hun- 
garian OTKA Grant 49384. 

A Conjecture on entropy of mixing 

We consider n + 1 uncorrelated identical systems where n systems have the 
same state p and a single system has a certain different state a, where both p 
and a can be given arbitrarily. Consider the following uncorrelated composite 
state: 



Then we assume that the single different system "looses" its identity among 
the other components, i.e., it becomes totally mixed with them. Let the 
resulting state be this: 



o-® p 



(17) 



R 



a® p® n + p®a® p®^- 1 ) + . . . + p® n ® a 



(18) 



71 + 1 



We define the entropy of mixing: 



S mix [a\p ; n] = S[R] - nS[p] - S[a]. 



(19) 
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We conjecture that in the limit n — > oo the entropy of mixing is identical 
with the relative entropy of a with respect to p: 

S mix [a\p ; oo] = -tr(alogp) - S[a] = S[a\p) (20) 

The proof of the general quantum case is missing. We present a heuristic 
proof for the classical case [a, p] = 0. 

Heuristic proof - classical case. We can directly estimate the increase of 
Shannon entropy caused by mixing. Let us consider a discrete d-state system 
and its diagonal density matrices with elements p a b = p a 8 a b and a a b = c a S a b, 
where a, b = 1, 2, . . . , d. If n is large, we can ignore all but the statistically 
relevant terms in p® n . Look at the components 

p ai pa 2 ---Pan , (21) 

and consider the string 

aia 2 a 3 ...a n (22) 

of labels. In the statistically relevant terms, the multiplicity of a given index a 
must approximately be np a for each a = 1, 2, . . . , d. Therefore, each relevant 
term has the same weight and the total number of relevant terms can be 
estimated combinatorically as 



iv. 



2 nS[p] ^ ( 23 ) 



(np 1 )\(np 2 )\ . . . (np d )\ 

which is the number of all different orderings within the string ([22)1 . Now, 
take the single state described by a a , insert the latter into the string at 
random and try to calculate the expected increase of the number of relevant 
configurations. Assume temporarily that a a = S a \. Then the above number 
of combinations acquires a factor 

" +1 1 (24) 



npi + 1 pi 

Eg. (j24j) means that the entropy increases by — logpi. Generalizing this re- 
sult, we can estimate the average increase of the entropy for any distribution 
o- a - 

- ^2 a a log p a - S[a) = S[a | p], (25) 

a 

which is the classical special case of our conjecture (|2()jl . 
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